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INTRODUCTION 



In the fall of 1970, the Ohiversity of California *s President Hitch 
made an urgent request for improved methods for evaluation a.id documenta- 
tion of teaching performance throughout the University. In response, 

U.C.L.A. *s Chancellor Young appointed a Task Force on Evaluation of Teach- 
ing. The purpose of the Task Force was to review the issue nationally and 
localXy in order to make reconmendations for the establishment of appropriate 
procedures for evaluation of teaching effectiveness on the Los Angeles campus. 

From the beginning, ^e Task Force considered the faculty *s opinions and 

practices regarding the evaluation of teaching to be a major reference for its 

reccmendations . Consequently, members of the Task Force designed a survey 

questionnaire to elicil: the faculty *s opinions on the nature of ev^uation 

qf -teaching, their perceptions of important criteria for- such evaluation, the" 

extent to >diich they were undertaking self-evaluation of their teaching » the 

methods they were using for this evaluation, and their recommendations for 

evaluation of teaching for the campus a.t large. The questionnaire, included 

in Appendix A, was mailed to all the canpus* approximately 2,800 faculty 
1 

members. 

Hie survey was limitesd by three trnavoidable conditions: (1) time re- 

strictions inposed on the Task Force precluded pretesting the survey question- 
naire; (23 the conplete survey had to be administered during the Christinas 
holidays when maiQ^ faculty were not available; (3) it was not possible to ad- 
minister a follow-tp survey of non-re'ipondehts. 

— p — ■ 

The questionnaire was sent to all faculty members listed on the 
payroll as of that date. This population includes visiting professors, 
tlinical professors in residence, and non-peiman^t jimior faculty. 
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Results iiidicated that all survey item^ were functional although a few 

could have been improved for clarification. Rate ot response was another 
matter. Two hun^^ and ninety-four c^xmpleted questipnnaires were return^, 
representing only approximately 11 percent of the faculty. Ordinarily this 
return might be considered a good response' rate u^r the circumstances 
since, accordi^ to the campus Planning Office, only 500 or 17 percent of 
the faculty return questionnaires during a regular quarter, even with follow- 
up requests. However, the faculty responding to survey on teachi]^ eyalu- 
ation obviously cannot be considered representative of the faculty as a ^diole. 

Al^ough those \d>o responded may not represent the opinions of their col- 
l^gues, the evidence, particularly the comprehensive responses to the open- 
ervled questions, suggests that the questionnaires received the serious and 
thoughtful consideration of most respondents. Indeed, the fact that those >dio 
responded m^ be biasj^ in a positive direction-- that is, more concerned ^bout 
evaluation and perh^s more conscientious in wishing to help resolve the issue 
of evaluation wn campus- -need not be a detriment- A major objective o£ the 
Survey was to determine if soiy trends emerged in the data concerning the facul- 
ty*s views on evaluation. The fact that these data came from faculty members 
who may be most concerned about evaluation of instruction is doubtless signifi- 
cant in itself since they were obtained from those vbo thought enough and cared 
enough about the letter to conimmicate their views. 

J^re important, perhaps, is the possibility that the respondents reflected 
a much larger proportion of the faculty than is indicated by their numbers. 
Subsequ^t interviews with a scattering of non-respondents indicate that this 
is probable. 
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The sijrv^ was affected by a fourth broad limitation. This condition is 
one vdiich inevitably will affect any future evaluation of instruction per se. 
Althougii it is often overlooked, instructors and instructional programs inter- 
act with the population of stud^ts vdio have their own goals and e^ectations. 
Systematic, thorough evaluation of instruction at the University retires the 
deamination of its highly interdependent elements- -the faculty, the curricula, 

student characteristics, and a host of other environmental phenomena- -in opder 

^ 1 

to determine the University's success in attaining its educational goals. Con- 
sequently, the evaluation of teaching effectiveness represents a limited att^^t 
to isolate one part, the instructor, ficm tlie total syst^ in order to evaluate 
his relative contribution to these educational goals, as well as his success 
in attaining his own objectives, ^reover, although there seems to be general 
agreement among many educators that the ultimate criterion of teacher effective- 
ness should be student growth, the notion of >diat constitutes silent growth 
often varies among tejichers. 

Despite the limitations im^sed lapon the survey , thet of the top- 

ic of evaluation of teadiing effectiveness at the University, together with the, 

V T 

extensive inputs of the responding s^lb and the. strong possibility that the 

r > ■ _ ' 'r ■ ‘ - 

responses reflect a- large c^tin^ of the faculty, to tl^ decision to 
analyze the surv^ data mote fully than was possible in the time given the Taslc 
Force. Again, the inpenrtance of the topic and the fittention it received firem 
the responding faculty Ijsd to the decision to disseminate the results Qf the 
survey beyond the confines of the Task Force. The stuv^ indicates the vaiying 
opinions and practices of the faculty regarding evaluati<nfi of teaching. Only 
^ture comprehensive evaluative reseaix^, however, can begin to approach a ho- 
listic evaluation of the intact of thb University on its students. 



The substance of this T<4>ort represents a first step in learning ii«hat 
the University is all about. Ensuing sections of the report mill discuss 
(1) the total responding faculty's orientation towards and recomnendations 
for evaluation; (2) the orientation of faculty fi^ di£fer«it subject 
areas; (3) criteria, practices, and recoiinendations advocated by faculty 

^ -V 

yitio conceptualize evaluation differently; and (4) tentative conclusions 
suggested by the data. " * v 






sanpling and exploratpp^ nature of the statisti 

cal tests> of ^ijpriiiicance of dif fbrences^^ i^^ .. A1 1 f iiidings and 

related iptei^ret , therefore , must be reg^ded as suggestive ra^er 
:-than concteive^ ■ 
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FACUtTY ORIEmATION 



Conceptualization of Evaluation 

The purpose of evaluat^g instruction is to make informed judgments and 

9 - * 

decisions about the development, implementation, and effectiveness of instruc- 
tion. Examples of evaluative questions are: Is the instructional sequence 

successful? Shoiud the instruction be revised in terms of time? Should 
the instructional techniques be changed? The evaluation, however, can be 
formal or inform^. Informal evaluations are judgments which do not necessar- 
ily involve explicit statements of the criteria upon which the evaluations 
are based. In formal evaluations, l)owever, explicit statements and objective 
measures of the bases pf tlie evaluation are ess^tial. Instruction is deemed 



”gpod'* only in relation to some st^uidard or criterion and all changes apd 
decisions are made with respect to objective ba^ for those decisions. M;>re- 
over, evaluation of instruction is esseitial for defensible decisions regard- 
ing the maintenance or modification of instruction. 

There are several commonly held conceptualizations of formal evaluation 
of instruction. For example, many teachers and adndnistrators conceptualize 
evali^tlon of instruction in terms of the characteristics of the conditions 
of instruction; for example, counting the hours of hom^rk, nutr0^^ of papers 
required, and nunber of hours spent in instruction. While it seems obvious 
that evaluation of this nature would not alone be ^ficient for making, deci- 
sions about instruction, many teachers speak ofovaluation of instruction only 
in terms of these characteristics. _ 



\e use the ‘ worl **conceptualizat ion*' deliberately. Its meaning goes 
beyond that of "concept." Rather it is "discovering the appropriate concepts 
that will put a group pf facts into a rational or useful Oraer." (English 
and English, 1958, p. i05>. 1 
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Ano^er conceptualization posits evaluation of instruction in teims of 
explicit changes in students' behavior. Desired changes in behavior are 
explicated in the foim of specific measurable objectives, and tests are 
developed to measure attainment of these objectives. Students are pretested 
prior to instruction an^ instruction is evaluated, accordingly, in terms of 
its results Or effects on each student. v 

Bach of these conceptualizations , and there a^ others , requires different 

, _ - ^■i ,r ■ 

methodological tools. Itetermining the faculty's conceptualization of'ev^iaa- 
tiori of instruction was intended to learn not only jdietJier their appiroadi to 
evaluation was formal or informal, but also to ascertain the necessary psycho- 
^tric procedures;; and the theoretij^ and practical issues involved. 

Oi the-total suirv^ s^le , 47 percent responded in some way to the 
conceptualization question; 53 percent did not respond at all. The responses 
were classified _intp five categories. The first category consisted of those 
whose responses indicated that they did have a real conceptua'* Ization of evalu- 
ation of instruction or at least who attenpted to formulate a conceptualization. 
TWaity percent of the responses fell in this category. Two percent of the 
^spcmses fell iritO the second category nAiich consisted of those faculty 
members nho either said Sie ^sticn was too ^fficuit and/or that tjiey were 
not prepared to deal vdth it . I^is does not necessarily mean that these 
faculty members refused to-aftswer the question because they were opposed to 

evaluation but that they preferred not to deal with the question at that time. 

■- ■ ^ ^ ‘ - - - . . ' - - ■ / ■ ■ • 

Five percent of the faculty decline to conc^tualize evaluation of ^ 

instruction becat^e of their stated biases against evali:^tion and/or their 
refusal to accept anything other than a highly subjective appraisal of their 
teaching. 
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Some faculty responded to this question in terms of the process rather 
thm a conceptualization of evaluation. Since taany educators think of ev^ua- 
tion only in terms of the process or procedures they use in evaluating, it is 
not surprisi^ that 7 percent of those responding, iidiich includes many faculty 
members >dio are not familiar with educational research and evaluation theory, 
think of evaluation in this way. Eleven percent of the faculty made diverse, 
**miscellaneous** assertions which did not fall into any of the above categories, 
t^ich as stating that teaching effectiveness does not depend on popularity or 
that students should be considered as individuals. 

None of the faculty concept jalized evaluation of instruction in terms 
of the characteristics of the conditions of instruction. Regardless of the 
level of sophistication pfr the donceptualization, both the "real” and the 
'*process" ^ccniceptualizations focused: tq)on the notion of student interest and 
growth. There were also strong implications ttet student growth should be 
determined by observable measures of growth or perfoimaia:e* 

Samples of representative staten^nts made by the faculty classified as 
"real" conceptualizatior's are presented verbatim as follows: 

1. As a process by which the individu^ is rated against a 
theoretidtl norm idiich would take into account-, among 
other things, the iiatitfe of the siAject mattOr taxj^t, 
the range of students taught, the achievement of learni^ 
goals, mastery of techniques, dOv^opment of reasoni^ 
sib^li ties, and all of this in a cost-behefit cont^— 
that is, how much of v^ues to the student, as a person, 
as a citizen» ahdi fls a producing member ti^sbciety, did 

/ the student gain in the long run in return for his in- 

"" vestment ani the instructor *s (society 

time, .energy ahd mbney in :the course. 

2. As an assessment of coKtructive dfm^e 

gf 0 ^^ deveijLo!^ on the" part of students as a result of 
' their work idth an instructor. 
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3. The 'evaluation of instruction must be recognized to be 
a subjective process but it does not follow that it is 
therefore meaningless. It does follow that data on 
effectiveness must be exteimve, diverse and carefully 
identified as to source. Although student rati^ sh^ts 
dp not provide an appropriate sole source of evaluation 
8iita, neither does ^e Dean's personal opinion or a 
chance impression of a colleague. All are required. 

4. The ideal method is long-tenn and virtt^lly impossible. 

How well do the students' do in later situations, both in 
courses and the outside world, involv^ the subject 
matter you presented? The situation is complicated ly 
the fact that learning is not due only to what goes on 
in class. On a particular level, I see no viable alter- 
native to seme method of carefully gathering opinion 
data obtained from students having tak^ courses, plus 
some more regularized ^tem of faculty visitation to 
classes. , 

5. Evaluation means jix^fing the effectiveness of a le^uming 
experience and the steps in .the process arer (l)/ ^te^r- 
mining objectivres ; (2) defining the objectives ih terms 
of behavior patterns; (3) developing methods for gather- 
ing: the data; (4) gather the data; (5) check the ^ta 
against the objectives; (6)^ replan. Self-evalt^tion is 
an important part of total evaluation and learning. 

As the evaluation of the extent to which students have come 
to understand the concerns and problems the instructor 
qnd the field he represents, and to h^e formed a mature 
opinion of its bearing on their own concerns and choice of 
society^in g^eral. 

- . - _ - ■ _ _ 

It begins with a teacher: who knows vhat and how he wants 
to teach; odio can set Ms own standards and then mauitain 
continuous interest in improvi^ 

8; As an assessment of construct i>^ change and professional 
growth developed on the ]^rt cf the students as a result 
of their work with ali instructor* 

Examples of representative statements classified as "process” conceptu- 
alizations are: 

1. In teims of ends achieved - to >diat extent did students acquire 
mastery of the instructional. Int^ts; and in terms of the • 
validity of instructional ends sewght - are objectives warranted. 
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r. 
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2. A procedure to determine how well the instnxtor contributes 
to studfent growth. 

3. Carefully; gather!^ opinion data obtained from students having 

taken a course plus some more regularized system of faculty 
visitation to classes. / 

4. I believe that student opinions should be the strongest indi- 
cator of an instructor's ability to teach and^ that these 
opinions are most meaningful after the student has been ex- 
posed to subsequent courses. Secondly, irregai^ess of 
student opinion, the instructor should constantly seek out 
new and better methods for conv/^ing information. 

5. Fe^Jback from all the students at the end of the comse is 
very valuable. Our departm^^t has a m^gchanism for this. 

6. ...Starts by specifying gpals--in’as operational* a form 

as possible. Inclu^^ identifying indicators of :^>al attain- 
ment, specifications of Obstacles to ^Is, \4ays of removing 
them, plan for collecting feedback, etc. 



The faculty members vdio declined to conceptualize evaluation of instruc- 

-<v7 ■ 

tion did so quite e>q>licitly by stati^ that it was either inpossible to make 



meaningful qu^tita^ve-^iidgments or that no attempt should be made to 
"quantify** instructional efforts . Examples of faculty members negative 



responses are: 

1. Instructiohal evalijation is extteately difficult in the 

majori^ of cases. Only when instruction is terrible 
or superb is the evaluation sinple. The entire middle 
ground Uppers to me vague, subjective and vei^ wq>en- 
sive inpiemen^ ^ ^ 

2. I feel ws are^moving in the direction of confusing teaching 
with learning and reinforcing the belief of many students 
tliat *'I had a bad instructor in that** constitutes an ade- 
quate Justification for their failure to master some mate- 
rial essi^ltial to their later >^rk. 

3. **Bvaluation** is a foolish tern, instruction ca^t and 
must not be evaluated* On :^e college and particularly 
j^ad level 901 of the student^ s **growth** d^>end;5 on the 
stud^t . The role of w 'ii)st^:tict6r can oidy be to smooth 
over the rough points,^ offer/izonnections.; mter-relations;; 
insights, not obvipus^M^e w work and above^all 
help the. sttd«sS^teach himse& A student gets out 



o£ a Cdft^^e at most \diat he puts into it. Thus, student 
evaliihtibn oFlnstruction is not only wrthless (corre- 
latibn bet»/een grade student gets and grade he gives in- 
stru^tor) and often the students downrate' the good in- 
structors who make them think (most students hate to 
think) but also the 'vdiole process destroys the instruc- 
tor's most potent means to get the students to learn. . 

4w Teaching is an art . As such,, it cannot be measured in 
quantitive terms. Moreover its effect should be of such 
a lo;ng-r£^e nature that most of the questionnaires pre~ 
sentiy in use are hopelessly inadequate; Questions seen 
directed at "training'^ rather than education. ... I know 
that there is-much pressure on the University from the 
public to measure its teaching function, pie public is 
not aware 6£ difference between ‘"training* and iedu- 
cation. The University im^t take a clear stand on these 
issues and txy to explain ^em to the public. 

5. As being a potential ^^r, if formalized, to academic 

ft'eedoia. ‘ - - 

6. I am very^imi^ opposed to the stasadardization and' routini- 
zation of criteria in this f isld. 

7. Instruction cannot be and ifiust not be evaluated. 

The statements vdiich we. classified as ^^scellaneous" were quite varied 
and none can be considered representative. The following statement, however 
was to the authors, one of the most interesting, where the respondent 
described evaluation of teachi^: 

"As the;^cant_^^of 1970; as of some assistance to the instructor; 

as of seme cathartic value to scents; as a groping toward 

an elusive but desired educational goal; as a stiede for the 
public to beat - the Uniy^sity' wi^^ . 

Criteria^. ^ . 

The faculty werp asked to hidicate udiich of eight criteria presented 
in the questionn^re they used in evaluating their teachingv The criteria 
were selected ftom -the Task Force ' s review of the literature as tiiose most 
commonly used in tbe evaluation of teaching effectiveness. The choices of 
criteria;^ presented in the questionnaire \terei 
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1. student growth 

2. degrw of student participation in the class 

3. variety of res«xirces axid techniqu^^used ' 

4 . student recoianendations for chan^s^ in (^^se content 

5. student reccmnendations for changes in instructional 
tediniques 

6. degree of student interest 

7. self-evaluation 

8. opinions and suggestions from colleagues. 

Although the faculty's task to choose among the criteria presented, 
they were also given the ^opportunity to specify aiy other criteria th^ 
used Which was not mentioned ih^the questionnaire. In addition, they were 
asked to define >diat they meant by certain criteria which might be open to 
multiple interpretations. SpecificsOly, the respondent was asked to define 
student growth, if he used this criterion, and also to explain >diat : he meant 
by self-evaluation if he checked $iat criterion. Finally, the respondent was 
asked to describe the way in which he measured these criteria ^ to return 
with his questionnaire axy formal evaluative instrimients he used. 

A considerable majority of the respondi^ faculty reported usa^ six of 
the eigh|: criteria: 

Degree of student interest (86 percent) 

Stxident growth or; ch^e (77 percent) 

■ _ I 

Degree of student participation in class (77 percent) 

Student recooinendations for changes in course content and 

. 4 ^ ■ 

techniques (75 percent) , ^ 

Opiniot^ and suggestions from colleagues (66 percent) 

^Student ^ reconinendations for changes in course Content and techniques 
were coined in the data analysis. 
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Thirty-five percent of the faculty ii^icated they used "other criteria" 
but only, a few specified their nature. Twenty-nine percent of the faculty 
checked that they included their use of a variety of resources and techniques 
as a criterion. "Student growth" was the one criterion which was defined in 
a variety of ways. Content analyses revealed the definitions to cluster for 
the most part into three general categories: 

1. The combination of an increase in intellectual awareness and 
application of knowledge (30 percent). Examples: "An in- 
crease in the awareness ahd accumulation of^knowledge and 
skill in the use of that knowledge for a ftdl life." "Widening 
of intellectual horizons, and integration o£ new knowledge into 
the student's existing fuiid of information and skill." 

2. Increase in intellectual awareness as such (29 -percent). Exam- 
ples: "Clmged intellectual ateeness of b^ic concepts." 
"Increased awareness of problems. " 

3. Understanding the course content or subject matter (28 percent) . 
Examples: "An increase in ability to Iwndle the subject matter.!' 
"Leaxiung the course material and becoming able to iise it." ; 

The majority of the/definitions, then, were based either on the combina- 
tion of a student's inqrease in cognitive knowledgej^us^^^o$^ in his 
perspective or an increased awareness of problems and critical issues. How- 
ever, awareness and perspective were not precisely defined and procedures 
designed to determine the presence of this awareness or per^ctive were not 
entinerated. 

A very small nunber of respondents defined student growth in terms of 
specific behavioral changes as prescribed by clearly defined instructional 
objectives. This definition included both cognitive and affective changes. 

A few respondents defined growth in terms of the student's ability to i:ise 
or^ apply factual data or theoretical concepts presented in class' to other 
disciplines. These answers were grouped with the combination category. 
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A very few* defined gro»rth in terms of the student’s ability to take 
responsibility for their own education: planning their own programs, doing 
inde{>end^t research work, completi^ given leamimg tasks to the student's 
own satisfaction; and. a sense of self-dir^tion ^ independence. A few 
defined growth in terms of some general sense of maturation but did not 

explain how such maturation could be assessed. 

> 

Procedures .for Evaluation 

)k) doubt few, if ary, professionals idbo are involved in teachi^ or its 
administration would argue that the evaluation of teachi^ is ai^rthi^ other 
than a very difficult process. Two major problans contribute to this difficul 
ty: first, establishi^ appropriate, consistent criteria for assessing 
teacher effectiveness; secondr, developing^and administering the requisite 
assessment devices . The latter point is bom out in the response to the 
survey question, "Htnv do you determine^ (student) growth?" = 

Content analyses revealed five main categories of responses regarding 
the methods used for determini^ student gj^wth: 

Contbination of written mater i^s, personal interaction, and 

direct observation (47 percent) . ' 

Vbritten mater ials exclusi^^ such as p^rs and eaumiihat^^ 

. (19 percent) . ' ■ 

Miscellaneous methods iipt othefidse specified (13 percent). 

Subjective observations (11 percent^ . 

Interaction with students thitugh class discussion and/or 

personal, contact (7 percent^ . * 

While the data ^ggest that the majority of t|ie faculty responding do 
refer to some indicators of student growth, such as examinations and written 
papers; questions such as jHhether the students Were pre-assessed prior to 
instruction, how objective the indicators were, and how relevant they were 



to growth ranain entirely unclear. Only in the miscellaneous group were there^ 

' f 

a few faculty members ^itio measured student growth in terms of the student's 
performance in subsequent related courses or on tests based on specified 
instructional objectives. In essence, the majority of the faculty seem to be 
in sympathy with the premise that effective instruction should cluuige bejiavior, 
but the clarity with idiich these changes are described prior to instruction 
and measured after instruction is doubtful.. 

These doubts are intensified by the lack of formal instrumentation deign- 
ed to systematically assess student growth. The lack of formal instruments 

* m 

designed to measure student growth is evident from the responses or rather 
lack of response to the item, "If you use any formal instruments, please 
attach. (If you have no copies of yoiii* instrument, please describe: ...)." 

Only 11 percent of those respondi^ attached or described such instrunents . 
Eij^ty^seven percent did not respond to this item or respond in the i^gative. 
It is possibly, however, that some faculty may not have realized that final 
examinations composed of items designed to measure particular leami^ 
objectives can constitute formal assessment of student growth in certain 
respects . 

Infoimtion about student recofmnendations'for ch^es in coitfSe content 
or tedmiq^ apparently Was obtained more systeii^tically than infcnnation 
about stud^t growth. Respcmses to '/Bow do you collect student recommendations? 
were classifi^ according to three major categories; 

Some form of written feedback (40 percent) 

h . ■ ' ' . 

A - ... r - 

Inf<>rmal comnentsVand/or discussion (29 percent) 

Combined" formal and infon^ procedures (24 percent) . 

Ihe remainnig sample either did not respond to or did not really deal with 
with the question. 
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In response to tho request for fomial instruments used to nssess student 
reconmendations, 37 percent of the respondents indicated that they did use 
some formal instrument. Sixty- two percent indicated that they did not. Over 
thirty different forms were received. Respondents were asked in three differ-' 
ent places in the questionnaire to submit any formal instmnents they used. 
Although a comprehensive analysis of the forms will not be made in tMs 
report, it should be pointed out that the instruments submitted were apparent- 
ly used to measure all student inputs, with the general exception of student 
growth. That is, student recommendations for changes either in course cont^t 
or instructional technique as well as, although to a lesser degree, the 
degree of student interest were measured by these instrtments . Despite the 
feeli^ expressed by many department chairmen that they required a unique 
form to evaluate instruction in their department^ the overlap be^een items 
used was considerable. The questionnaires were design^ to assess: - 

1. the instructor Vs sensitivity to stu^nt' needs and feelings 

2. the instructor's enthusiasm and involvement in his material 

3. the instructor's knowledge of the subject-matter, particular- 
ly of recent developt»hts ; 

4. the instructor's teadx^ style; quality and fairness of exams; 
relevance of the t^t and assig^nts to coarse objectives 

5. general comments regarding the instructpr as. a person. 

These areas almost exactly parallel the items most commonly found pertinent 
to the rating of teaching in a series of studies conducted across the country 
Csee e.g., Eble, 1970; midebrand § Wilson, 197D; McK^^ 

The responses to "How do you determine student interest?'' —the criterion 
checked by the largest proportion of the faculty (86 percent) -- were 
classified as follows: 



student participation and enthusiasm in class and out of cl&ss 
discussion (51 percent) . 

Subjective impression exclusively (15 percent). 

Combination of written and inform^ feedback (14 p^c^t). 

Formal feedback through written comments or formal questionnaires 
(6 percent). 

* 

Typical responses classified as "subjective** were **throu^ the .pores" 

+ • • ' ' 

or **by intuition only, teacher Worthy of the name knows perfectly.^weli 
whether the students are interested." Althou^ 17 percent of the faqtLty 
responded to the itm which asked for formal instruments, and those used 
were presumably ix^uded with the ^rms described above, few instruments 

'C ■ . 

asked the students to ra|e their degree of interest in the course. A few 
departments used an open-ended format; and, althou^ the questions asked 
were very similar to those uaed in the rating scale forms, they d^ j^rmit 
tjie student to express his feelings and intere^^ carefully, if he chooses. 

Approximately 75 percent of the respondaits checked self-evaluation, and 
the responses divide fairly evenly between those clarified as subjective 
(44 percent) those classified as non-sid)jectiver(41 perc That is,, 
even thoush the term se|f-etraluation implies subjective judgments, one*s 
self-evaluation he te^ed pti objective measures . acamples of faculty 
statements classified as **subj^tive*^ wwe: "I believe that the competent 
teacher can sense whether his teachi^ methods are getting across** and **I 
have faith in my own judgment about W teaching. **:^^the kinds of responses 
classified as non-subjectlve consisted of; **1 i^ll from the soiswers to exams 
and from; their questions whether or not 1 explained the material well** and 
"1 compare present student criticism to remarks on past questionnaires and 
look for recurrent comments.** The non-subjective means of self-evaluation, 
then, i are based on documented feedback^ both solicited and; ut^oliclted. 



Of tile 66 percent of the respondents vdio checked as a criterion the 
opinions and suggestions ^txnn colleagues » 20 i^i^ent indicated that the 
opinions and suggestions fron colleagues concerned their course content; 7 
percent stated that help from cplleag)|es concerned ihsttuctional techniques 
and 52 percent indicated a comibination of both* Several respondents indicated 
that colleagues regularly sat in on their lectures and seminars and that they 
then exchanged conments and criticisms. On the o^er hand, several respondents 
indicated that there was very little colleague input, (tae ra^er plaintive 
comnent was: ”In the four years Pve been here, no colleague has offered a 
single st^estion or criticism relative to the courses I conduct. While I 
appreciate this as a lack of pn^ssure, it also makes me wonder if anyone ca^es. 

Ihe diances are tluitiBost faculty care a great de^.^.C^^ recent study 
oftindversity pxo^etsors ieveaj.ed that tliey place their teaching role ahead 
of their research. Several studies have a^o indicated that, if ^ything, 
there is a positive relationdiip between professors * research productivity 
and students* rating of their teachii^ effectiveness (see e.g., Eble, 1970; 

Gaff and Wilson, 1971rmidebrand a^ . 

Faculty Recownendations / 



« Of t^ total questionnaires received, 58 percent of the faculty respond- 
ed to the item requesting recooinendatipi^ and suggest^ for canpus*wide 
evalua^oh of instyuCtion; 41 percent did not respond. Although the item 



asked the faculty to offervreconimendatians for campus’rwlde^ evaluation of 
. diitStructicih; it 'was apparent that a distinction was i^e-^eti^n a canpus- 
Wide depptmental systm a canpus-wide non-dep^tyien^l system. We 
<^assifi^ ti^ responses k:cord^ly. Ten percent of those reSpondih^t 



offered reCoft^ndatic^ evaluative proc^tii^^t should be 

^ instx^ted within d'^Piwr^^^ the results of the ev^uatioh confined to 
: departmental files. IWenty^'seven percent :&dicated that evaluation ^ - 
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insttxiction should be instituted on a non-dei>artmental basis, that is, a 
central canqpus-mde system for collecti^ and processor the evaluative data. 

It should be noted, however, that the majority of both the departnental 
and the non*departmental recommendations indicated that evaluation should 
be based on student ratings of all courses collected through some type of 
formal instrument. A minority of the responses recommended a variety of 
other types of evaluation procedures, such as the use of *’outsidb** evaluators 

from other departments or other liniversities or by requiri^ tape recordi^s 

■^1 

. , V J 

or video tapes of a random selection of each professor's classes. A few 
responses were entirely negative; that is, the recommendation xvas to forego 
evaluation completely at least in axiy formalized manner. 

'C' 

A few representative reccmiiendations have been selected to exemplify 
each of tiiese classifications. Exaniples of campus-wide departmental and 
non-departmental Valuation recommendations are presented verbatim as 

1. It should be done primarily by students; s^idents should 
be required to fill out course and pi^essdr evaluation 
forms sit the end of each class; turned in directfy to de- 
partments only. 

2. Campus-idde evaluat^ioh is not ^ssible or even ddsir^le. 

Students ihduld record On their st^ 

structpr they; bad and the worst. The worst should be 
visited by aii^aliiator, >dip would only provide the^^i^^^^ 
structor witii a list of recommendations cb hpw to 
his clWsrocm effectiveness. ^ 

3. A (brefuliy designed ^mifbrm student questioibaire; a 
CoriqE»rable quest lomaire for colleague evalibtion. ■ 

4. Studbit evaluatibi^’ sunmariz^ and feicrts prepared by son^- : 

iine outside the ^faculty mmnib^r ' s d^partmebts so that the per- 
son would r^ih objective and be in&uenced by the porson- 
alities involved. . ^ 

5. Student evaluations now being done become the official me^ 

of course evaluation. ^ 
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6. The students* professor evaluation booklet provided there 
is a minimum mmiber required before reported. 

7. Professor evaluation booklet vdth analysis of students* gpa's 

taken into consideration.: . 

Several of the recommendations indicated that student ratings should 
include graduates and periodic follow-up: 

1. Opinions of other faculty members of the department; opinions 
of stu^nts who have graduated and been particularly success- 

: : ful;^,op^ons_ Qf^^^ opinions of graduate studiiints 

on in&rg^uate courses in the same depEu^eiit . 

2. Feetock from graduates as to long-range impact of instruction 
and instructional programs. 

3. Each student reqi^red to submit a 2 to 3 page Critique of the 
course and -instructor. 

4. Solicit the subjective opinions of present and former students — 
but only oi the very best and most advanc<^ students. 

5 . Solicit appraisals from stud^ts at several intervals after com- 
pleting a class, after 1, 2 and 4 years as evaluations chiange 
as perspective dMm^s. 

6. Qiiteide examiners who are hired to interview stud^Mits and facul- 
ty about the teaching quality of candidates for promotion. 

7. A department or division of the university (school of education) 

ayailahle to all faculty to instructively evaluate and criti- 
cize < te«^^ performance. 

8. Visiting teams for each discipline, perhaps from another campus, 
which evEduate the program; iic!Me interviews vdth faculty mem- 

7 " : bers> examination of instiiictional materials , etc . 

9. A grottp of students and faculty be selected course auditors 

: and that the representatives sent to audit aiy jorticular course 
beio^ to an outside field. . - 

10. No formal mechanical method is possible. Our prchiems are due 
to structural factors; tack of support of teachirig, reward- 
system focused on researdi, lack of institutional concern with 
education, particularly lower division. 1 fiud it amazing that 
our faculty is as devoted to teaching as it is, in the^ face of 
the fapt.™t their -personal interests certainly lie elseidiere. 



24 
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11. We ou^t to spend a good vMle £ig(pi^ out just \diat it is that 
we \iant to measure, then a good \Adl6 figura^ out \diat accessible 
variables are promising surrogates for idmt we*d really like 

to measure, then a long \diile experimenti^ and ^rovi^. The 
crash project attitude should be,, replaced hy dedication to long- 
term continui^ action research on the measurement and improve- 
ment of teadii^. 

12. There should never be colleagues or adtainistration officials 
in classrocms acting as-evaltmt^rs.^^^ 

13. A generalized scheme that would be applied on a c^o%us-wide 
basis would be a serious mistake. The most valu^ informa- 
tion has come from students idio had been aiway from the uni- 
versity for a number o£ years. 






SUBJECT ARE/V VARIATIONS 

MDSt of the faculty identified. their departments; this provided the oppor- 
tunity to examine, to some extent, the faculty's differences in ori^itation to 
evaluation by academic disciplines. Since the restricted nunhers precluded 
coidparisions by specific departments, the responding fa<^ty were classified 
according to departmental areas as follows; 



Area 


NiiUber 


Percent 


Humanities and Social Sciences 


87 


29.6 


* 

Sciences 


40 


13.6 


M^cal School 


58 


19.7 


Other ProB^si^na^ Schools 


42 


14.3 


Unidentified 


67 


22.8 


Total 


294 


100 



No dod)t many characteristics distinguish faculty in different disci- 
plines within the broad categories eiiployed, and these ou^t to be delineated 
with respect to teaching; effectiveness in future research. In the meanth^, 
our assumption ds '^t the categories distinguish among those facul^ in- 
volved in the "purely theoretical" 0T "a^^ ^stdplines 
and Social Sciences); the more theoretical, "hard" s^ences; and the more ^- 
plied disciplines ctf the Mbdical and Other Professional Sthoqls . Hie remain- 
iag "unidentified" groi;p consists of respondents idio did not identify their 
departments. In so far as the responding faculty are representative of their 
nonresponding peers, the survey results shouldL be indicative of a^cts of 
orientation to. evaluafion of teaching uniqi^ to major subject areas as de- 
' fined. The basic data are shown m Appendix B. 



- 22 - 



Conceptualization of Evaluation 

As previously reported less than half of the faculty responded to the 
question, "How dp you conceptualize the evaluation of instruction?” Di£Eer- 
ences in response rates among departmentai areas were nominal, ranging from 
40 percait for the Sciaices to 51 percait for ^e Humanities and Social 
Sciences. Only 20 percent of the faculty submitted answers that were judged 
to be real conceptualizations of eygduation, with a range of 10 percent for 
the Sciaices to 29 pergsitt for the Professional Schools. Another 7 percent 
of the faculty answered the question in terms of the actual process pf eval- 
uation. Area differences were hbodnal in this respect, with the largest 
proportion (12 percent) coining from the Hunanities and Social Sciences. 

A sniall proportion of the faculty (2 percOTt) stated that they felt this 
question was too difficult to deal with. This vas the case for 5 percent of 
the faculty from tiie Sciences and Professional Schools. 

Thirtemi percent of the Humanities and Social Science faculty disagreed 
with the whole notion of the conceptualization of evaluation compared with 
only 2 to 3 perc^t of the Science and Professional Sdiool faculty. None of 
the M^cal SchoG^ faculty took this position. ^ 

Tfecoimmndation^ 

A majority of the responding faculty offered some recommendations or 
si^gestions for evaluation of teaching at U.C.L.A. Differences among 
partmental areas were nominal in this re^ct (62 to 66 percent) with the 
e3«:eption of the relative lack of representation from the Medical School 
(47 percent). 

J^raximateXy 3 percent of the faculty from all d^artmental areas rec- 
ommended that there be no evaluation at isdl. Here too, differences among 

- ■ \\ . ■ ■ - ■ . ■ . 
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departmental areas were nominal (2, to 3 percent) with the exception of the 
fact that none of the Medical School respondents negated the function of 
ev^aluation, but 7 percent of the faculty from the other Professional Schools 
stated that there should be no evaluation of teadiing. 

Over one- fourth of the faculty recomnended that evaluation be uniformly 
carried out on a campus-^de basis. Ihis position repr^^ the greatest 
consensus on the matter, other than the suggestion that the method of eval- 
uation be based primarily on student ratings. The recomnendation for canpus- 
wide eyalt^ation also reflected some area variation, the range being 20 per- 
cent for the; Sciences perc^t for the Professional Schools. 

The s^ relatively small proportion of faaUty from each area ( 7 to 9 
percent) felt that evaluation should be inplemented by departments rather 
than canpus-wide. The only possible departure from this pattern .came from 
the Sciences, 23 percent of idiose faculty reconinended departmental evalua- 
t^n* The Huauaiities:^and Social Sci^ce faculty (28 percent) were most in- 
clined to offer miscellaieous suggestions ^art from canpus-wide or depart- 
mental equation delusively; the Other Professional Schools’ faculty were 
at least inclined to do so (5 percent). 

Few, if any, of the differences in conceptuali2ation and recommendations 
regarding evaluation of teacMng among departmental areas appear either very 
striking, cemistent, or symptomatic. The same holds true regarding the re- 
ported use and deteindnation of evaluative criteria. The median percentage 
difference among departmental areas on the 27 variables shown in Table 2 of 
)\ppendix B is 11 points. In only 7 instances did the most extr^ie g^roups 
differ by more thw 15 -percentage, points. Mthoug^ thc^ was little con- 
sistency or little in the w^ of patten)^ of differences, the data do 
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indicate that the Humanities and Social Sciences faculty were generally the 
most circumscribed of the groiq;>s in their use of the criteria and in their 
systematic use of formal instrumraits to assess attainment of these criteria. 



o 
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INTER-RELATED ASPECTS OF DIVtRSE ORIENTATIONS 

The data reviewed indicate that the faculty surveyed hold different at- 
titudes toward and different a^roaches to evaluation of instruction. Under 
the circumstances » we felt that it was in|)ortant to consider how thos& ^o 

differed in their orientation to evaluation regarded more specific aspects 

- - * 

of evaluation of instruction. Therefore » we classified the re^^ding fac- 
ulty according to nAiether or not they: 

1. offered their conceptualization of ’ evaluation " 

2. considered sti4^J..interest as a criterion 

3. offered recomnendations for evaluation procedures to be instituted 
at UCLA. 

Conceptualization 

Through the content analyses of open-ended responses » an effort was made 
to determine the extent jto iMch faeully me^^ had a developed conc^ 
ization of evaluation. These analyses resulted in the finding that 68 per- 
cent of faculty vho made recopiendations for evaluation procedures at. UCLA 
also had some fbrm of a conceptualization of evaluation » and » more specifi- 
caHy, 29 percent of the teconiiendii^g facul^ l»d idiat can^ 

“real” conceptualization conpared to 7 percent of the faculty idio did not 
make recommendations. Another 11 percent of the recomnending faculty con- 
ceptualized evaluation in terms of the actual process of evaluating ii^truc- 

- - - ' ■ ■ . - _ .1 ■ - ■ 

tion. That is, they spoke in terms of the procedures th^ used or the pro- 
cedures they felt'^ouid be used to evaluate instructl^^ Within this 
classification, too, there were some differences; the “process evaluators^’ 
were more Ipeely to.define student growth in terms of student understanding 
of course content whereas^ the ^’reai evaluators” were more likely to define 
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student growth in terms of the students^ general awareness and intellectual 
understanding and also the students* ability to s^ly knowledge in new sit- 
uations and to new pidblents. 

In sum, those faculty members ^o presented a conceptualization of eval- 
uation coiqpared with those ^o did not were as a group more likely to define 
student growth in terms of the students' ability to understand course con- 
tent, the students' ability to apply knowledge, and on the development of 
the students' awareness and understanding. Ihat is, this group offered a 
definition, of student growth coqpared to those Adio checked student growth as 
a criterion but did not define \diat they meant by student growth. In addi- 
tion, the faculty members >dio presented a conceptualization of evU^tion 
were more likely to use a formal instnanent for evaluating their instruction 
and considerably more likely to include student reconmendations for changes 
. in course content in their evuiwatlon*= _ , 

Student Interest 

It was not surprising to find that a considerable majority of responding 
faculty selected student interest as an inportant criterion also took 
seriously st^ent reconmendations for changes in course content, in contrast 
to those >dio did not b^icate student interest as a criterion (81 percent 
verses 1? percent) . For the most part, however, there are only nominal dif- 
ference between the two groips in terms of the manlier in which th^ collec- 
ted these reconmendations. There is one notable excep^l^ however, i^rox- 
; iJimte^^ one-haifuf^ the:facalty^<ds6^ini^udC^ student interestTamong=-^eir— 
criteria for evaluation of teaming aTso reported using class participation 
as the means by which they coUeCted student reconmendations conpared to 
one-c{uai^®^ of the faculty vho did not report xising student interest as a 
criterion. 
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Recoitinendations 

As it turned out, those faculty idio made reconiiiendations and suggestions 
for evaluating instruction at UQA differed relatively little from those \dio 
did not make reconmendations on most variables examined in this contest* 

Here again » however, there wer^ some notable exceptions. The faculty viib 
made reconmendations were much more likely to indicate tliat they also used 
self-evaluation measures. Only 15 percent of this group failed to respond 
to this item conpared to 40 percent of those vdio did not make reconmenda- 

■T 

tions. . \ - 

There was also a tendency ^r those who^made^recomnendations, in con- 
trast to those idio did not, to draw tpon a variety of means of self-evalua- 
tion particularly with respect to their reliance ipon their own judgments 
(41 percent versus 20/^rcent). At the same time 70 percent of the faculty 
iho made reaminen^tions: i^^rte^^ attenti\re to opinions and sugges- 
tions colleagues conpare:!^; to 58 perc^t of tho^e vho did not. Four- 
^ teen percent^of those idio made recbmro^datipnS_ did not check student growth 
as a criterion coiipa^ to 35 percent of those idio did not have recommenda- 
tiors. 
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OONCWSIONS 

1. Teaching and its e'^aluation are complex issues, particularly in a 

large, complex university. TTiis fact is bom out by jone of the niost frequently 
raised arguments against evaluation of college teadii^. Elements of the 
argunent are: that campus-^de evaluation is not possible or eyen desirable 

■jr ■ - . - 

because of the diversity in agreement regardi^ evaluative criteria an4 prac- 
tices among professors of different academic disciplines; tbkt the qualities 
that make an instructor effective in one discipline are not necessarily the 
qualities desirable in another; and that, therefore, evaluation of teadhi^ 
must alM^ be considered, if at all, only in tem^ of the discipline taus^t. 

To the ext^t that the ^ove analyses vMcK distin^ among broadly 
classified academic areas are indicative, iKiwever, there is more general con- 
sensus than^ diversity wi^ respect to tte usefuliiess of evalt^ 
vant evaluative oriteria, me'^ods and even fbxinat, evaliiation of teadiing 
effectiveness on a can|)us-wide basis , and particularly the use of student 
ratij^s for this pinrpose. 

The obvious si^estion that-emerges in 
consequently, is that a cosandii, canpus-iiiDde-systaii of 
evaltiatibn of teaddng be inqplemented on can^; that 
it include the range of peitinent criteria aitd practices 
and that it systematic include student rati^ of 
teaching. , 

2. Most of the respond^i^ f aC timt they used student 

interest as a criterion for evaltiation of their teaching in some fashion. 

The extent to ^ch this Indicator of teaching effectiveness was obtained 
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objectiveiy and systematically warraits greater clarification, particularly 
considering that objective infoimation of this kind can be obtained with 
relative ease across disciplines . 

The greater majority of the faculty als^ ^ytted lisl^ student growth 
as a major criterion in evaluati^ their teaching e:^ectiveness ; The sub- 
jects or areas of ejqpertise and the types of skills in which the student 
grows do. Of course, vary in diffenUig degrees among disciplines. More- 

ds 

r 



PS 






effectiveness* This <;riteri<m has to dp Xrith the process of teaching rathdr 



faculty. The distinction is iinwrtant. Gifted that the outcome of teacdiing 




~ ins^^tlon;^ means may vary from arte instructor to another. 



dvese-di^ar^^ meaiK can be used to accomplish identical ends or goals with 





as they can lead to the attaiiment of different goals. An 
obs^ec^le but comparatively ?mall proportion of the respoito faculty reported 



us^ "the variety of r^ources and tecltfiiques used" as a criterion of teachi^ 



than the outcooL^ ich as *!student growth," checkedhy so many of t^^ responding 




.given outcomes tfeih^ot^^ instruction 



is of prim^ concern, a major. reason for ev'sluath^ of instruction is 



to determine if that inode contributes more efficiently and more positively to 
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Ihe suggestion in this respect, therefore, is that 
evaluation of teaching carefully include and care- 
fully distinguish the outcomes of teaching and th% 
processes leadi^ to the outcomes. 

4. Ihe large prcrportion of responding faculty >dio reported usi^ 
student growth as a criterion for teaching effectiveness did not e3q>ress 
an identical opinion of ^diat student growth means or how it is to be 
measured. No doubt the faculty at large would ha\?e even more variant 
definitions: of student growth. Ihe plications of this possibility^ for 
^a cpus-idde system of evaluation are considerahle. At the least, be- 
fore such a syst^ is instituted, a concerted effort should be made to 
assess reliahly the entire faculty's definitions of important criteria 
and suggestions for their measurem^t. V^le it may not be necessary to 
have rigid definitions of criteria in order for a can^js^de s^tem of 






evaluation to be successful, certainly there sh^d be as gr^^ cons^us 



as possible ox opinion regarding def ^tions of and ways to.measure map 
-criteria,^___ - . . / '^v.- ' ' ^ 

Ihe s’^eaftion th^efore, is that a small (and there- 
fore eccnoiidcal),ra|[^msple of iKlA'sfac^ 
surveyed to validate and exdarge upon the preset study. 

5. iparen'Uy, a ccnsideraible majority of the faculty is syn|»athetic t% 
some form of evaluation. At the same time, a minority of faculty menberc are 
ndamant in their opposition the >diole^ notion of evaluation of teaching . 
Many of ^ese "dissidents" t xse legitimate questions and problems concerning 
effective assessment end evaltiation of teaching which ^ould be taken seri- 
ously. But these problems should not absolve iripructors from taking respon- 
sibility for the cons^uences of their teaching any more than students should 
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be absolved from the responsibility for the consequences of their learning 
behavior. Moreover, the humanities professor (most likely to object to 
evaluation) should be no less responsible for the consequences of his instruc- 
tion than the scientist. Perh^s, however, some of those faculty >dio oppose 
evaluation of teaching do so because they do not have a real understand!^ of 
the nature of evaluation. 

There results two suggestions; that an ongoing progj!^ 
be instituted to educate and inform the faculty as to 
the nature and positive effects of evaluation, and that - 
.continuous means be established to take into account 
arid deal with evaluation issues and differences of opin- 
ion raised by questioiung fact^ty. 

6. Individual fiicult^ members also rais!' 1 specific, unique suggestions 

. . 

for evaluatorS' of teaichirig such as videotapin' selected lectures or enploy- 
ing outside evaluation from other d^ftmef^«s or cami^es. Other faculty 
membm awareness that teaching does not take place as some 

<^sCT-ete ^tivity isolated to a particular cdass^ but rather e<3totional im- 
pact is the result of accumulative, interacting variables that coohine to 
form the total college; edt^ experience.' This means that these inter- 
acting variables are in as much need of evaluation as the faculty jttenber*s 
teaching, khen theSv l^ints are added to those raised above, then, it is 
all the more evid^t that effective evaj^tion of teachi^ effectiveness 
is a complex, time-consuming, professional enterprise. At a minimum it en- 
tails: (^lineating and developing i^roprlat^measw^ of important 
criteria ari4 techniqws for effective teaching; developing effective tech- 
niques for the actual equation of teaching; eaqieririmriting wi^ new forms 
of evs^uation; monitoring the evaluative process, to assure its continued 
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£^ropriatenesj5 and to eliminate its problems; detexmini^ the accutoula- 
five effects of the component parts of the educational process and its im- 
pact generally; and develop^ effective means of dissaninati^ the results 
of these activities. The nature of these activities are such that they re- 
quire the full-time efforts of professional personnel trained to undertake 
them. 

The inevitable resultant suggestion is that UCLA 
establish a modest facility designed to conduct 
evaluative research and develo|iDent as described 
in an effective, efficient manner not otherwise 
possible. 

7. A final point to consider is that evaluation of teaching, no matter 
how well conceived and executed, remains a sensitive matter At issue is the 
potential evaluation has for abi^e as well as for contributing to teaching 
effectiveness. This possibility was the basis for mudi of the criticism of 
the minority of f^^ty >dio opposed ev^uation. The possibility can certain 
be eliminated. Yet it is real enough tha^ the concludi^ si^estion is posited 
even at the risk of seeming gratuitous. 

_ =The wgent suggestion; is 7 that eval 

in tdiateyer form be; established in sudi a^ 

the academic free^ and individual rigtits of both 

faculty and students be safeguarded at all times. 
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DEPARTMENT OF EDUCATION 
LOS ANGELES. CAUFORNIA 90024 



Deceniber 17, 1970 



Itear Faculty Matiber: 

We are witing in reference to Chancellor Young’s Deceniber 2 memo- 
randum outlinuig ^e sti^s he taken in response to President Hitch’s 
policy statement on in^rovement of undergraduate teaching contained jLn the 
November 9 issue of the University Bulletin. You will recall jthat an im- 
portant part of this cam^ respoi^e is to be carried tlE^gh a Task 
Force on Evaluation ehair^ by Dr. Raymond Orbac^. ^he objectives of the 
Task Force are to collect pertinent informa^on Si evaluation programs 
here and elsevdiere in the United States in^S?der to make the best possible 
preliminary proposals fpr adoption by this campus. 

An overriding concern of the Task Force is that it contribute to the 
enhancement of the teaching- learning function of ^e University without 
in way debilitat^ the University’s research function and witltout 
vioB^^l^ its tradition of academic freedom. 

The Task Force is also concerned that it provide the basis for the 
faculty of this campus to govern itself, rather than being governed 
others less understanding of the nature of the University. Consequently, 
we are asking you to specify the methods use to evaluate^ effec- 
tiveness of your instruction. Likevdse^ we are seeldng your views on 
the function of evaluation and your suggestions For the iaplementation 
of evaluation Of instructica^-on a canpus-wide basis. This infonnation 
will greatly cqitribute to our reconniendations regarding the best pos- 
sible method for instruction y^ch ^ at the same time 

bb most acceptable to tiie greatest number of facud^ possible, kei^lng 
in mind that diverse forms of evaluation will probably be called for in 
the face of the diverse functions and characteristics of this ihstitutioh. 

We only have a few days in vdiich to complete this poll of the faculty 
This f Quires us to ask you to respond under the same &ress affecting 
us as we solicit your views. It is extremely important that we get your 
candid opinions as quickly as possible and that you include in your re- 
actions any qualifiratijns or additions that you think ought to be made 
in refer enc^_to oucogjestionnaire. 



All infonhation will be t^ted co^identially unless we have your 
specific peimissioa to reference £uny of ;^ur statements. We are aslci^ 
for your name in the event that we may wish to query you further about 
your viewpoints or to obtain y^ permission to reference them. We 
will be most grateful if you will return the enclosed questionnaire 
pronptly to: 

James W. Trent 

320 Moore Hall ' 

Campus 

Thank you, 

(signed) 

James W. Trent 

Vice-Chairman 

Task Force on Evaluation 



faoSty opinion on the evaoiaxion of instruction 

WHAT CRITERU IX) YOU USE IN EQUATING YOUR INSTRUCTION? 

Please check the criteria you use and expladn hovf you use them. 

1. STUDENT GROWTH OR CHANGE 

How do you define growth ? ' 



How do you determine growth? 



If you Oise any formal instruments, please attadi. (If you have no 

, c ■ ‘ ■ ■ ■ -i ■ ■ 

copies of your instrument, please describe: - 

■ ' - : " ' - - ' - ' ) 

2 . Tl® DEGREE OF ST^ IN THE OASS 

3. THE VAR]^ OF RESOURCES AND TECHNI^ USED 

5. STUiXBtn: iiHXMieawriGNS ipi ouNGBS, 

How do you collect the student recoaiiiendatiQns?_ - 



If you use any formal instrunents, please attach. (If you have no 
copies of your instrument, please describe: 

■ ■ ; ; ' ; ^ - _ / - J 

J5. THE IHSREE OF STUIffiNr INIEREST . ' " “ 

How do you determine student interest? 

If you use any formal instruments, please^attach._ (If you- have no 
copies of your instruments please describe: 



V®!? ■ 



SELF-EmUAXI®!. (Please Explain) 



-f ■ .lii 






8. OPINIONS AND SUGGESTIONS FROM CX)LLEAGUES. 



(Do these suggestions usually concern course content or instructional 
tediniques?)_ - - 



9 . OTHER. (Please Specify) 



J r 
[ 






f 



OPTIC^IftL : If ^possible please coraplete the follaSri^ and return the form with 
the questionnaire. 

HOW DO YOU CONCEFIUALIZE THE EVALUATION OF INSTRUCTION? 



WHAT REOQM4BNDATIONS AND/OR SUGGESTIONS DO YOU HAVE FOR CAMFUS-WIDE EVALUATION 
OF ^NsrfeucriCN? 



I 




TABLb 2 

USE AND EBTEKMINATIG^J OF CRITERIA FOR EVALUATION 
OF TEACHING REPORTED BY THE FACULTY^ IN PERCENT 





- 






Other 








Humanities ^ 




Medical 


prof. 








^cial Sciences 


Sciences 


School 


Schools 


lfi.sc. 


Total 


— — — - 


OJ = 87) 


(N »' 40) 


(N = 58) 


(N » 42) 


(N '» 67) 


(N « 294) 










r- 






Degree of StudefcOrowth 


- 


\ 










Criterion used 


82 . 


72 


74 


76 


76 


76 


Definition; Uf Student Grcwth 




- 


■ 








^ Lkvterstanding course 


- 




. 


- 






. JBaterial 


24 


16 


33 


31 


12 


22 


Aiirareness and under- 














/st^ding 


22 


20 


17 


21 


28 


22 


A{iplication of knowledge 


26 


- ■ 


19 


14 


28 


23 


Determination of JSiowth 












■ 


P?^rs an^7 exams 


24 


S 


S 


17 


9 


13 


Ipcussioh'jl intetaction 


3 


10 


9 


S 


3 


5 


- Ci^inatipn 


2S 


38 


36 


31 


40 


33 


Observation 


6 


S . 


9 


S 


12 '■* 


8 


, MisceUane^ > 


16 


S 


S 


12 


6 


r 


Formal instrunent used 


10 


15 


17 


26 


6 


14 


Degree of Sinctent Interest 














Criterion iised 


70 


78 


78 


83 


81 


77 


Determination of Student ^ 




1 - ’ ■ 










Interest 


: r - - 





~ ~ '-I?'- 




- . 




Intuition ' 


13 


8 


. 9 


17 : 


18 


13 


Ifritt^ 




-■ ■■ 










(Escussion 


. : 12 


18 


: ^ 7 


7 


16 


13 


Qtiestioismre 


1 


3 ‘ 


2 


2 


3 ^ 


2 




3 


3 ^ 


“"3 ■ 


’ 0 


2 


2 


Class 


43 


48 


S3 . 


38 


34 


43 


Formal instrument used 


16 


23 


16 


21 


- 13 

1 


17 














_ 










■■ -- 




1 









ERIC 



TABLE 2 (Cont'd) 





Humanities ^ 
Social Sci(ances 
(N«87) 


Sciences 
W = 40) 


Medical 
School 
Qi « 58) 


Other 
Prof, 
Schools 
(N^ » 42) 


Misc, 

(N « 67) 


Total 
01 294) 


J - I 

Student Reconmendation 














for Ch^e in Course 






' - 








Content 














Criterion used 


67 


85 


76 


74 


78 


75 


Detenpination of Student 














Recon^ndations 






■ ■“ 








Written coonient^c 


ID 


5 


5 


9 


0 


6 


Form^ instruneiit 


18 


43 


24 


26 


25 


26 


Informal comments 


9 


5 


16 


12 


8 


10 


Combination written 






- 








and iiifOrmal cqiments 


17 


30 


21 


12 


27 


21 


Discussion 


. 17 


ID 


19 


12 


i5 


15 


Ijpression 




0 


0 


0 


- 3 


2 


Opinions from C6llei.gues 


^ -_ 7 .. 




■ - ' 






- 


Course content 


9 


13^ . 


9 ' 


21 


18 


13 


Instructional tech- 


■ - >■ 












luques 


8 


3 


7 - 


0 


3' 


5 


Content ^ techniques 


29 


40 


35 


29 


39 


34 


Jfiscellaneous \ 


■ 9 


5 


P 


12 


. 3 


6 


Other Criteria (feed 














,lfee; of a variety Off ! /; ■ 




■■■■' 








tqdmiques . 


/ 36 




"33"' 


" 33 


13 


29 


Seif evaluation 


70 


80 


62 


71 


69 


70 


rO^er criteria 






31 . 


48 


- 21 


35 


” - ' ' . . - .. -■ 




- : . "- 


. - - - 


. _--■- 


t- . _' - -■ 




' ■ ' ' '■ ■ " ■ " ~ 




S - 




■ 




. ■ ' 



--- ^ t 



- - 






"■*■ ^_- -"p _-_. 



_-■ ■'->5 ^ -■ ----■-'f-t j- -.T- ■■- - ■■■■ - 
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